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Investigations into the Instructional Process 

IX. Pupils' Goal-related Behavior during the Instructional 
Interaction 



1. Introduction 

It is often mentioned that what pupils think and feel 
during the instructional process cannot be recorded in a 
reliable way. The only means to get information about pu- 
pils' thoughts and feelijigs seems to be retrospection, 
i.e. , interview of pupil^^ immediately after the instruc- 
tion. Siegel et Al . ( 1963). have made an attempt to strength 
en such a retrospection by using CCTV in the. following way. 
The lesson was videotaped and played back to the pupils 
immediately after the instruction was closed. This replay 
was interrupted at regular intervals to allow the pupils 
to write down thoughts they had had while the recalled sit- 
uation had been going on.-Dn the basis of these recollec- 
tions, strenghtened by TV, Siegel classified the pupils* 
thoughts according to their relevance to subject matter 
and, further, according to activity, independence, and so 
forth. ^ 

The subjects in Siegel's investigation were undergrad- 
uates which was also the case in Bloom's experiments. It 
seems doubtful whether younger school . chi Idren are able to 
give reliable information in such situations (cjF. Kosken- 
niemi 1971, 92). Elucidation of this problem therefore 



Only after making use of the idea of. stimulated recall 
by Siegel, in a way described later in this report,' have 
we found out that Bloom had already presented a solution 
principally identical in 1953. 
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requires repeated experiments at this age level. What fol- 
lows is a description of an attempt to analyse what fourth- 
grade pupils can tell about their activities during the in- 
structional period, when they are aided by an immediate re- 
play of a videotape just recorded. 

The arrangement of the experiments was entrusted to the 
junior .;3tithor of this report, and he is also responsible 
for coilucting and processing the material (Paragraph 3). 

2. The Need for Breaking the Black Box 

What is the reason for our interest in what happens in the 
minds of pupils during the instructional process? 

As already mentioned in previous reports of investiga- 
tions into the instructional process at the Institute of 
Education, University of Helsinki (abbreviated DPA Helsin- 
ki) published in Resear'ch Bulletins numbers 26 to 32, and 
34 (see, e.g. . No. 26, pp. 8-9, and No, 34, pp. 61-62), 
the first part of this project consists in const ructing a 
comprehensive, re liable and valid taxonomy for describing 
the instructional process, especially in its interactive 
phase (this term as defined by Jacksun 1962; 1 9683.. The 
accumulation and analysis of material for this purpose has, 
owing to the limited resources available, progressed slow- 
ly. The taxoncmical instrument is^ howevpr, now ready for 
the next part of t he "p ro j ect , comprising the period from 
summer 1973 tc summer 1976. 

Briefly the strategy 'of DPA Helsinki is as follows. 
Fi rs t , by using the taxonomy mentioned above we intend to 
describe • chains of ins tructional periods., e # g . , all weekly 
lessons in a classroom. In this connection wc try to find 
out, in terms of certain process variables^ invariances 
within each separr^te period and, further, relations between 
consecutive periods. 

Second , descriptions of instructional periods will be con^- 
pared with certain group of independent variables assumed 



to remain relatively constant during each period, such as 
"goals", "teacher", "pupi^K characteristics " , and "class 
structure". These variables will be-^'used for explaining 
the descriptions of different periods as such and as tem- 
poral chains (cjF. the paradigm on the next page); 

As the instructional process , among its other aspects, 
by definition is a purposive one, various intentions under- 
lying the daily work in a class room must be considered as 
variables of importance. Goals drawn up by the teacher and 
agreed upon by her pupils or, in the ideal situation, decided' 
jointly by the teacher and her class are in fact one of the 
prerequisites for effective study. 

In this short report there is no reason for discussing 
to what extenl: goals really are being formulated, concre- 
tized and decided in ordinary school life ~ either by teach- 
ers or pupils or by both together. The DPA Helsinki project, 
however, required arrangements through which these impor- 
tant variables could be operationalized in one way or an- 
other and taken into account. 

The school c-lass at the Institute of Education (Grade 3 
or 4) has therefore through repeated exercises been trained 
to plan the next few days* programme within the weekly 
schedule and make decisions concerning it. With the help 
of systematic observation , either directly or through CCTV, 
it has been possible (although not easy) to rate the pres- 
ence of certain goal -related behavior during the planning 
period, at least when concentrating on the most typical pu- 
pils of the class community. 

After the. school days which were preceded by joint plan- 
ning an evaluative period for discussion of the realization--^ 
and success of that plan was arranged. Such a situation pro-: 
vides opportunity to observe , i . a . , whether any goal-related 
behavior has remained in; the pupils. If so, it seems.- to 
justify the interpolative conclusion that corresponding be- 
havior has also been present between planning and evalua- 
^ ■ ^ ' ^ during instructional situations proper. 



Fig, 1 , Research strategy of the DPA Helsinki 
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Such a conclusion, however, is certainly vague. The 
stimulated recall, mentioned at the beginning of this 
paper, now comes into consideration. This arrangement 
seems to provide means to control the presence of goal- 
related behavior, which otherwise is based on a kind of 
interp elation. 

Stimulated recall must of course be regarded as an un- 
natural break in the daily flow of study, and it can be 
used only a few times within a chain of . i ns t ruct iona 1 sit- 
uations. This procedure presents, on the other hand, the 
only way to control if pupils* behavior is related to 
activated goals also during ordinary study situations af- 
ter joint planning and deciding r. 

The modest experiments described in the^ex.t- paragraph 
K'jsre arranged partly in a class 'wlThdut''^ experience of " ' 
detailed and systematic planning of study, partly in an- 
other class which had been trained in joint decision-making 
in this respect. In both cases we tried to find out whether 
fou rth -graders are capable of rating their own goal-rele- 
vant behavior and the behavior of their peers in study sit^ 
uations with help provided by video recordings. 



3. The Procedure and Results 
3.1. Experiment One 

There are many reasons for assuming that fourth-graders 
are not capable of reproducing their thoughts during certain 
study si tuations , as Siegel's subjects were asked to do. In- 
stead, we asked our subjects to rate the behavior, their own 
and their peers*, from a number of various viewpoints. To 
facilitate this task the rating was done by .ranking all 
group members according to certain behavior, relevant to 
the situation . 



The problems: ".- 

(1) Are pupils capable of distinguishing different aspects 
of task-oriented behavior in ranking group members ? 

(2) What stability do such ratings have? 

(3) How valid are these ratings as criteria when compared 
with experts ' ratings? 

In Experiment One (1971) the subjects were ...a fourth- 
grade study group (two girls, tv-;o boys) which met four 
times with intervals of one week. The topic the group was 
studying was the conservation of nature. The task was ac- 
companied by short instructions given by the teacher. Each 
session was videotaped and replayed for pupils immediately 
after sessions. 

The recal] situation was divided into ten-minute sec- ■ 
tions and after vievving each'-^ct ion the pupils had to fill 
out a q ues tionnai re.. wi'Th t h e f o 1 lowi ng q ues i: ions : 

(1) Who in performing the, given task was the most industri- 
ous in' the group? Rank the other group members in order. 
Includeyourself. 

(2) ' Who p resented most opinions of his own and asked for 

others' opinions-?-' Rank the group members in order. In- 
clude ^your'self. : 

(3) Who gave, suggestions and guidance? Rank the group mem- 
bers in order. Include yours elf. 

(4) Who was the most productive in the solution of the task? 
Rank the group members in order. Incl u de y o ursel f . 

Later on, two experts viewed the same videotapes and 
rank-ordered the group members according .to the criteria 
(1) C4). In addition, the experts also rated (5) plan- 

fulness and ( 6 ) tenaci ty at work. 

The measure used for agreement between pupils' rankings 
within each ten-minute section andforeachcriterion is 
based on Kendall ' s Coefficient of Coneordance, W (Hays 1963, 
656-658). It is obtained from a matrix of rankings, each 
pupil (placed in vertical order on a s eri es of ■ rows ) rank- ■. 
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ing each pupil (placed in horizontal" order on a series of 
columns], as follows: 



W = ^2 S 



where S equals the sum of the squares of the deviations of 
the column totals from the -grand mean, and n' equals the num- 
ber of individuals ranked .by m observers. In this case n=m, 
since each pupil ranked " everyone in the group including him- 
self. When agreement is. perfect, W is equal to 1, and when 
there is no agreement at all W is equal to 0 (Bales & Slater 
1955, 276). 

To analyse the third problem, mean rankings for lessons 
1. to 4 and -throughout lessons were calculated for both pu- 
pils and experts. These figures were compared with each oth- 
sr. . 

Table 1 (p. 8) illustrates the pupils' mode of ranking 
the/group members: in.t e r- ra t er ag reement capacity to dis- 
tinguish between different aspects of study behavior, and 
stability of rankings over sections of a lesson. The means 
and s t andard devi a tion s of rankings by pupils and experts 
for all lessons are presented in. Appendix 1. The agreement 
between pupils' and experts' rankings concerning individual 
*g roup members is shown in Figure 2 (p. 9).. 

Table 1 .indicates that pupils have .a very high consen- 
sus when ranking each other in different aspects of task- 
related behavior. W-coefficients wit hin • ranking sections 
are, with some exceptions , systemati cally high. One expla- 
nation seems to be that the group in question was small an-ci " 
that the behavior pattern of one of the group members (B) 
did not vary at aTl. It must also be remembered that Kendall's 
W does not take the ranker-agreement by chance into account, 
and that the high values are therefore partly of a technlcar ' 
character. 

. When looking at Appendix 1 it can.be seen that the mean 
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ranks and standard deviations are quite stable from one 
ranking aspect to another and similarly from lesson to les- 
son* The only exception are rankings of pupil C who is more 
variable than others in her behavior and, consequently, more 
difficult to be ranked . 

The agreement between pupils' and experts' mean rankings 
over- lessons v.s illustrated in Figure 2. These means are very 
close to each other in every aspect, which can also ;be seen 
from correlations between the mean rankings: 

iesson 1 r = .97 all lessons =".95 

lesson 2 r . 90 

lesson 3 r = .88 

lesson 4 r. = . 95 

The experts also rated planfulness and tenacy at work 
( cf . p. 6), but these rankings appeared to be very close to 
those obtained by rating the^ other aspects of behavior. 
Tenacy at work, e.g. , seems to overlap too much with indus-- 
triousness to allow differentiation between these two. - In- 
ter-expert agreement as such was considerably high. In a 
total of (16x5=) 96 cases W was found to be 1.00 in 60 cases, 
.90 in 16, and .70 in 20 cases. 

Despite the technical biases it seems justifiable to , 
conclude that both pupils', and experts' perceptions of task- 
related behavior in group work show systematic similarity. 
Both are stable but different aspects of behavior cannot 
be distinguished from each other./ This seems to validitate 
the role differentiation hypothesis stated in several small 
group in vest i gat ions . 

3.2a 'Experiment Two 

A second experiment was carried out two years later 
[1973). with a new group of fourth-grade pupils (two girls, 
two boys) , topic under study being Siberian vegetation zones. 
Before group work the members had part icipi tated in joint 
planning of and decision on future work with the teacher and 
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Fi g . 2 . Mean Ranks of Pupil Behavior: 

Rankings by Pupils (o) and Experts (+] over Lessons 
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other pupils of the class. 

One lesson was videotaped and immediately played back 
to the group. The questionnaire 'to be filled out was very 
similar to that used in the first" experiment, but an addi- 
tional question v^as introduced: Who followed the common - 
plan most properly? 

As Table 2 indicates, the rankings performed by pupils 
are again very consistent with each other. Kendall's coef- 
ficients are rather high within all sections and aspects, 
the only exception being Planfulness [Who followed the 
common plan most properly) where the W's are rather low. 
The same fact is seen in standard deviations of- pupils' 
and experts' mean rankings [Appendix 2) which are higher 
in the fifth ranking than in others. 

Experts' rankings are, as judged by the standard devia- 
tions, more consistent than the ones done by the pupils. 
This is also reflected in the W's. The agreement .between 
experts' and pupils' rankings was, on the other hand, very 
high (r = .96) . 

4. Discussion 

Both experiments indicate that, pupils and experts per- 
ceive, the interactive study behavior in group work very 
similarly. This behavior is characterized by a clear role 
differentiation, i . e . , goal-related behavior of pupils re-- 
main quite stable from the beginning to the end of the les- 
son. The accuracy of these perceptions, however, decreases 
when more complex patterns are to be assessed. 

Comparing the results with those obtained by Bloom and 
Siegel, it seems that at fourth-grade level it is not pos- 
sible to describe and/or classify separately complex chains 
of goal-related study behavior, neither by information ob- 
tained from pupils in stimulated sit uations nor by experts/ 
ratings. Even though the pupils rank their behavior consist 
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ently, the halo effect apparently plays a prominent role in 
thei r percept ions . Reliable and specific information about 
behavior related especially to the jointly discussed and 
decided study goals could not be obtained in this way within 
a small material like ours. It is possible that the group 
situation with its emergent role differentiation overshad- 
ows the. joint discussion of the goals to be strived for. 

More experiments wit h specified and concrete definitions 
of goal-related behavior in different study, situations and 
at different age levels are therefore needed. 
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